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Abstract 

We report on the image reconstruction (IR) problem by making use of 
the random chiral g-state Potts model, whose Hamiltonian possesses the 
same gauge invariance as the usual Ising spin glass model. We show that 
the pixel representation by means of the Potts variables is suitable for the 
gray-scale level image which can not be represented by the Ising model. We 
find that the IR quality is highly improved by the presence of a glassy term, 
besides the usual ferromagnetic term under random external fields, as very 
recently pointed out by Nishimori and Wong. We give the exact solution of 
the infinite range model with (7 = 3, the three gray-scale level case. In order 
to check our analytical result and the efficiency of our model, 2D Monte 
Carlo simulations have been carried out on real-world pictures with three 
and eight gray-scale levels. 
PACS numbers : 02.50.-r, 05.20.-y, 05.50.-q 
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INTRODUCTION 



Recently, statistical mechanical approaches to the problems of information science 
attracted much attention of the researchers who are working in the field of information 
science. Among these, a particular interest has been given to the techniques by which one 
tries to reconstruct an image from its corrupted version, e.g. sent by a defective fax, a fickle 
e-mail et cetera., since any data transmission through a channel is in principle affected by 
some kind of noise. In the mathematical engineering fields, the traditional way to obtain 
the optimal recovered image has been regarded as a sort of optimization problems. In this 
framework, one first constructs the energy (cost) function so that this function represents 
the distance between the original image and the recovered one as properly as possible; 
then, one minimizes it using suitable heuristic methods like simulated annealing In 
fact, Geman and Geman succeeded in constructing a method of image restoration 
using simulated annealing, and they discussed in detail the properties of its convergence 
including the optimal annealing schedule. 

Successful results in this direction have been reached by means of the usual techniques 
of disordered spin systems, assuming that each spin is naturally associated to a pixel or 
bit. In the language of the disordered spin systems, the optimization problems we just 
mentioned are naturally translated into the search of the ground state a system possessing 
many local minima of order exp(A^). In contrast, Marroquin et al. |^ found that the 
temperature of the system plays an important role for the image recovering process. 
From the statistical mechanical point of view, each recovered image can be regarded as 
the equilibrium state of a random spin systems. Marroquin et al. investigated the 
effect of the temperature on the quality of image restoration by computer simulation 
and found the optimality of finite temperature image restoration. Recently, this finite 
temperature effects on image restoration was checked in a more careful way by Pryce and 
Bruce |Q, although these works were restricted to numerical simulations. In the context 



1 



of the convolutional error-correcting codes, Rujan [^] proposed the finite temperature 
decoding in which we regard the sign of the local magnetization at a specific temperature 
(this temperature is well known as the Nishimori temperature in the field of spin- 
glasses) as the correct bit. Recently Nishimori and Wong [0] pointed out that the optimal 
restoration of an image is also obtained at some specific temperature and showed that 
image restoration(IR) and error-correcting codes theory (ECC) can be treated within a 
single framework. Indeed, to the usual IR Hamiltonian, ferromagnetic and random field 
terms, they added a spin-glass term borrowed from the ECC theory used for parity- 
check. They could exactly solve the infinite range spin model and find the optimal values 
of the temperature and the field (referred to as hyper-parameters from now on) at which 
the best retrieval quality is achieved. However, their works are restricted to the case of 
Ising spin systems and in this sense they are able to restore black/white pictures. On 
the other hand, there remain many open questions about the restoration of multi-color 
images or, somehow equivalently, gray toned images. This kind of problem has been also 
widely studied in the context of neural network with multi-state neurons, able to store 
and retrieve gray-scaled patterns (see P] and references therein). For our purposes, we 
therefore map the set of the pixels onto g-state (chiral) Potts spins, with a ferromagnetic 
Hamiltonian in the presence of a random field (conventional IR) and, further on, a glass 
term {ECC-like term). The choice of the chiral Potts Hamiltonian is motivated by the 
fact that it exhibits the same gauge invariance as the Ising glass, although a work for the 
usual random Potts model is under consideration. Here, we show that, as in the Ising case 
0, the presence of the glass term significantly increases the quality of the reconstructed 
image. We should mention that several remarkable studies about IR using the Potts 
model have been made by several authors. However, their works mostly depend on the 
computer simulations. In addition, their methods (mean field annealing |T0|, cluster 
algorithm |]TT],0], etc.) are devoted to the restorations at zero temperature. Therefore, it 
seems that there exist a lot of open questions about IR using the Potts model, especially. 
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about the performance of the finite temperature restoration. 

In the next section, we will introduce our model within the image restoration theory 
and adopt the overlap as a measure of the restoration quality. In Sec. Ill, we will discuss 
the infinite range model and give the exact expression for the overlap as a function of the 
temperature and the external field, thus obtaining a relation between the temperature 
of source image and that of restoration temperature. We shall also see the improvement 
of the restoration quality by adding the glassy term. Finally, in Sec. IV, guided by the 
infinite range results, we will give explicit and realistic examples of image reconstructions 
for three and eight gray-scale picture. 



I. THE MODEL AND IR FORMULATION 

As already mentioned in Introduction, we choose to represent pixels of a gray-scaled 
image by means of g-component Potts spin variables. The usual Potts Hamiltonian H = 
— J2^cricr admits a complex representation [jl3| by means of the following identity 



y r=0 

where each spin takes on one of the q roots of unity 

(Ti=expi—Kij {Ki = 0,---,q-l). (2) 

From now on, we will use the notation {^} for the original pixels and {a} for the variables 
of the recovering process. Let us now send the original image through a noise channel not 
only by the form of ^[ itself but also by the following products = Without 
loss of generality we raised the spins and their products to some power r, since this 
corresponds only to a rotation in the complex circle. The reasons of this choice will be 
clear soon. For this expression, the output {{t^^^}, {J^^^}) is stochastically determined by 
the channel. For instance, in the case of a Gaussian channel (GC) the output function 
Pout({J(^')},{r('^)}|{0) is given by 



Pout({j('-)},{r('^)}|{0) 
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where jf,^^ and r/''' are complex numbers which satisfy 



(q-r) 



(4) 



in order to insure the realness of the sums in (^. 

(r) 

Obviously, if a noise-free transmission could be achieved, we would obtain t- = ^[ 
and J-j'^ = il'^iy The conditional probability P({cr}|{J*^''''}, {t*-'"''}), which is probability 
that the source sequence is {a} provided that the outputs are {J} and {r}, according to 
the Bayes theorem reads 

P({a}|{J«},{r«})~exp i^Y^ at^ af'^^ + '^T^T. P^i^) (5) 



r=l 



where -Pd(cr) is a model of the prior distribution -Ps(^), that is, 

P.(a)^exp f^EE^f^^r 



(6) 



(ij) r=l 



Our choice of the above prior distribution (|^) is due to the assumption that in real world, 
images should be locally smooth. From this point of view, the distribution (P) is suitable 
because it gives high probability if the nearest neighboring sites take a same value. 

For the Ising model, in order to get the restored pixels out of the average quantities, the 
pixel at site i (to be denoted as Sj) is naturally taken as the sign of the local magnetization. 
This means that the restored pixel is chosen as S = +1 (S = —1) if the spin points upward 
(downward) on average at the equilibrium. For our model, instead, since the value of the 
local magnetization is not simply confined to the interval [—1, 1] but it runs all over the 
complex circle, we introduce the following generalized restored variable 



Si ((cTi)) = exp 



a=0 



2n _ 



(7) 



with 



^a[x) = H X a H — 



6 fx a ) , 



9 being the usual step function, and 



6i = tan 



(9) 



In simpler words, Sj is the closest spin on the circle to the value of the local magnetization 
((Tj) = (Re [(Tj]) +i (Im [cTj]). For g = 2, it is straightforward to check that reduces to a 
sign function up to a normalization constant. The quantities (Re [uj]) and (Im [ai]) are the 
average over the Boltzmann distribution e^^'^" with the following effective Hamiltonian 



g 



q—r 
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(10) 



i r=l 



The condition (|) gives the above Hamiltonian the same spin gauge-symmetry as Ising spin 
glass, thus suppressing the spontaneous magnetization at low temperature which is present 
in the usual random Potts model. For the restoration purposes, the random field term 
aligns the spins according to the corrupted picture, whereas the ferromagnetic term insures 
the smoothness, by suppressing the isolated pixels within one small cluster. Therefore, 
a balance between (3^ and h) will helps us to reconstruct the original picture well. The 
first term, instead, has been recently introduced in the problem of image restoration by 
Nishimori and Wong and this term has been well known as the parity check codes in 
the field of error-correcting codes. Obviously, this term carries much more information 
about the original picture than the other two terms. Therefore, the performance of the 
image recovery is expected to be improved by this term. As a measure of the restoration 
quality, we shall adopt the following overlap M 
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M 



q-l 
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y r=0 i J r 



in which (1/g) Ylt=o at each single site gives 1 if the original spin is in the same state 

as the restored one, and zero otherwise. Here the dependence on the local magnetization 
is buried in the angle 9i, give by Eq. (^, and the sum over all the sites is understood. The 
main goal of this paper is to maximize the overlap M as a function of the temperatures 
{f3j and Pd) and the external field h (referred to as an estimate of the hyper-parameters) . 
In the next section, we will start with an exactly solvable model, that is, an infinite range 
version of the Potts spin-glass. 



II. MEAN FIELD SOLUTION 

We will now investigate the performance of our model within the mean field approxi- 
mation, viz. each spin is influenced by all the others. As the source image, we will consider 
a ferromagnetic state generated by a Boltzmann distribution at some finite temperature 
Tg. For the sake of simplicity, we will restrict ourselves to the case of g = 3, although 
the results can be generalized to any value of q. We thus assume that the original set of 
pixels {^} is generated by a ferromagnetic 3-state Potts Hamiltonian with probability 

(12) 

where Zs{l3s) is a normalization constant and jSg is the inverse source temperature. Ac- 
cording to the conditional probability, the observable are computed as 

[mu,r} = E E E PiU^'^}, {r^'^}m)P{0 ^^-^ (13) 

i J r ^ 

with 

Z = Tr,exp(-Kff). (14) 



MPs 
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It is rather straightforward to average out the disorder by means of the well-known replica 



trick |T^ and, assuming replica symmetry ansatz and isotropy (no dependence on r), the 
saddle point equations for the order parameters are given by 



[Re[e.](a[)]=ti = -ERe[e]e 



1 p^{m''pKe[i]+-mfhra[i\) 



dv_du_ _„2_^2 Zcos(0 



(15) 
(16) 
(17) 



X 



du dv 



Here mSp and nSp are simply the real and imaginary components of the source magne- 
tization, viz the usual non-random Potts model mean field equations 



[Re[e.]]=m« = i-(e'^=™^'' 
[Im[e.]]=mf = ^y3e-i^='"^'' 



e-|/3.™i''cosh [(V3/2)/3,mf) 
sinh [(\/3/2)/3, 



(19) 
(20) 



and 



Zs 

ZcosiO 
ZsiniO 
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(1) 



+ 2e- 5/5=-''^ cosh [(73/2) 



(2) 
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with 
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Finally, the overlap M is expressed as the following weighted average 



5 V^r 
receiving contributions from the following g = 3 regions in the complex circle 
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(23) 



(24-a) 



(24-b) 



(24-c) 



We first assume that the exchange term is absent = 0) ||T^, that is no redundancy 
is fed into the channel. In this case, the saddle point equations ([T^-|TB|) are drastically 
simplified and the overlap (|23 |) simply reads 



M 



-Erf 



-V2 



/3dm + Toh 



rh 



e 2 



Th 



(25 



with the magnetization given by 

e^»"^= r du 

m - 



2 1 - exp[-|(Mr/i + /3dm/q + Toh)] 
Zs J a/vF" l + 2exp[-^{uTh + Pdm/q + Toh)] 



2g-iAm. . i_exp[-|(Mr/i + /3rfm/g-roV2)] 

H~ zz / ^6 



(26 



Zs J ^ l + 2exp[-f(Mr/i + /?dm/g-roV2)] 
where we defined Erf(x) = dx/ ^/n. 

The problem is thus reduced to a one-dimensional model, corresponding to an Ising 
model in which the length of spin turns out to be (+1, —1/2) instead of (+1, —1). This 
is not surprising if one thinks that the fluctuations along the imaginary axis are governed 
only by the glassy term, meanwhile the magnetic field acts along the real direction. In 
Fig. in, we plotted the overlap M as a function of Td for the some values of h. It is 
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straightforward to check that the maximum value of the overlap Mmax does not depend 
on magnetic field /i, since at the stationary point {dM/dPd = 0) m is proportional to the 
magnetic field 

= (27) 

This feature holds also for the Ising case, although the stationary equation ( |27 1 ) is simpler 

Psm, = mPd^. (28 ) 

Expression ( p7 1 ) is thought to be valid only for the infinite range model, as confirmed in 
the next section by numerical results in c? = 2. 

Now we set the decoding temperature at the optimal value, that is M(T^''*) = Mmax 
and we switch the exchange interaction 7^ 0) as depicted in Fig. |^. We notice 
that also a small amount of redundancy highly improves the value of the overlap M^ax 
which quickly increases and slowly decreases, after the peak, meanwhile the exchange 
term becomes dominant on the ferromagnetic one. 



III. MONTE CARLO SIMULATIONS FOR REAL WORLD PICTURE 

Although for the mere restoration aims it is not wise to smoothen two points far away 
from each other, we shall see that the infinite range model provides a useful guide for 
the more interesting case of real-world pictures, since the results remain qualitatively 
similar. We thus carried out Monte Carlo simulations for realistic pictures with short- 
range effective Hamiltonian. In this case, the ferromagnetic term will be concerned only 
with the points within the range of interaction and two points far away will not influence 
each other. It would be extremely interesting to study the restoration quality as a function 
of the interaction radius, but this goes beyond the aim of the present work and we limit 
ourselves to a first nearest-neighbors interaction Hamiltonian. Therefore let us consider 
a simple g = 3 gray scale level picture (upper left of Fig. |^), where each pixels has been 
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randomly flipped to another value with some probability, say p = 0.15 (upper right of Fig. 
^ ) . The curves shown in Fig.^ are the result of the restoration process without the glassy 
term, that is jSj = 0, at different values of the ratio H = h/ (3d- Here the maximum value 
of the overlap is achieved around ifmax=/'-//5d ~ 0.6 and Trf~0.2 and the corresponding 
restored image is drawn in the lower left of Fig. ^. Adding the glassy term at i/max fixed 
improves drastically the value of the overlap and the quality of the restored image (lower 
right of Fig. |^), drawn at the peak of the Fig. ^ The same procedure is repeated in 
the presence of higher noise, p = 0.30, at the same -ffmax and Pj-max and the results of 
the restoration are shown in Figs. ^. Finally, we applied the same algorithm to an eight 
gray-scale level picture with 20% and 30% of noise, upper images in Figs. |^ and ||. The 
results without exchange term are shown in Fig. 0. Once again we find a maximum for 



some values of and H and the corresponding restored images are in Fig. 10. 



IV. CONCLUSIONS 

In this paper, we investigated the possibility of gray-scaled image restoration using 
chiral random Potts model. We exactly solved the infinite ranged version thus deriving the 
explicit expression of the overlap as a function of the estimates of the hyper-parameters 
h, (3d and (3j. In the absence of the glassy term, we obtained the exact relation between 
the restoration temperature (3d and the source temperature (3s which gives the maximum 
value of the overlap. This seems a highly non-trivial result because it is natural for us 
to assume that the best recovery of the image should be achieved for (3d = (3s, as it 
turns out to be true for the Ising case ||^. The Monte Carlo results on real pictures 
confirmed the expected high improvement due to the presence of the redundancy, i.e. 
the glassy term. However, so far, in our prescription to recover a corrupted image at 
the best restoration values, one is supposed to know the original data. In other words, 
the receiver has to meet the sender at least once to find the optimal restoration values. 
Only after that, the other receivers will be able to get an optimal restoration for the 
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same image, provided that the channels remain, at least qualitatively, unchanged. In this 
sense, it would be extremely useful to provide some a priori criteria (the receiver will not 
be supposed to meet the sender) for the optimum values of the hyper-parameters, once 
that some intrinsic characteristics {e.g. temperature) of the original image are known. 
Therefore, in order to check if the relation (|27 | ) still holds down to two dimensions, we 
restored g = 3 ferromagnetic snapshots generated at some known temperature. However, 
so far we have not yet obtained reliable results and detailed investigations in this direction 
will be reported in a forth coming paper. 
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FIGURES 

FIG. 1. Overlap M as a function of for different values of h. The maximum value Mmax 
does not depend on h. 

FIG. 2. Overlap Mmax as a function of the exchange temperature (3j for several values of Jq. 
The overlap improves even for small values of the exchange term. 

FIG. 3. Upper left: original three gray-scale levels image. Upper right: 15% of noise. Lower 
left: restoration without exchange term. Lower right: restoration with exchange term. 

FIG. 4. Upper left: original three gray-scale levels image. Upper right: 30% of noise. Lower 
left: restoration without exchange term. Lower right: restoration with exchange term. 

FIG. 5. Overlap M as a function of the decoding temperature at /3j = (left). The 
system size is 64x72 and each line is averaged over different 4 samples. 

FIG. 6. Overlap as a function of (5j. We set the parameters (if, r^;) = (0.6, 0.2) which gives 
the maximum in the absence of the exchange term. 

FIG. 7. Upper left: original eight gray-scale levels image. Upper right: 20% of noise. Lower 
left: restoration without exchange term. Lower right: restoration with exchange term. 

FIG. 8. Upper left: original eight gray-scale levels image. Upper right: 30% of noise. Lower 
left: restoration without exchange term. Lower right: restoration with exchange term. 

FIG. 9. Overlap M as a function of the decoding temperature at /3j = (left). The 
system size is 93x100 and each line is averaged over different 4 samples. 

FIG. 10. Overlap as a function of f3j. We set the parameters {H,Td) = (0.6,0.1) which 
gives the maximum in the absence of the exchange term. 
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